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ity of fuzzy automata perfomiing a mutation opera- 
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(54) Title: HEURISTIC METHOD OF CLASSIFICATION 
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to classify the Objects and measure the fitness of the chromosomes of the g 
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Description 

BACKGROUND OF THE INVENTiON 

5 1. Field of the invention 

[0001] This invention relates generaily to signai classifiers, and, more particuiarty, toa signal classifier which employs 
fuzzy genetic teaming automata. 

10 2. Discussion of the Related Art 

[0002] Typical passive sensor systems which collect wideband signals are receiving an enomfious flux of infonnation 
from a continually evolving signal environment This enomious flux of infomnation threatens to exceed the capacities 
of the human signal analysts to analyze the data. As a result, there Is a pressing need for artificially intelligent systems 
15 which uic ly analyze the arriving data stream, and, while so doing, effect machine learning in order to adapt to the 
continual signal-environmental changes. The intelligent systems should filter the signal data by identifying and sepa- 
rating nown signals from the arriving flux of signal information. This potentially reduces the wor load for the human 
signal analyst by allowing him/her to focus attention on signal features which are more 11 ely to contain mission-impor- 
tant Infonnation. 

20 [0003] Adaptive front-end signai classifiers are generally nown in the art Conventional front-end signal classifiers 
utilize many inner product-based schemes which compare the aniving signal to a set of basis functions that serve as 
exemplary signals. These Inner product-based schemes may be based on Fourier analysis, wavelets, and/or Gabor 
transfomns. In each of these schemes, the computational Intensity is high and there Is little flexibility to adapt to a 
changing signal environment 

25 [0004] Therefore, it is desirable to provide an adaptive signai classifier which leams to identify specific embedded 
spatiotemponai signals in an aniving signal data stream of an evolving signal environment More specifically, It is de- 
sirable to Implement a signal classifier using fuzzy automata. Fuzzy automata generally use min-max aggregation to 
process the Incoming data, thereby obviating the need for highly intense Inner product-based comparisons to exemplary 
signals. Since each fuzzy automata is a language-learning system, only one re ulrement needs to be imposed on the 

30 signals that are to be ac uired a signal needs to be characterize ble as occurring in one or more states and transitioning 
as a whole or partially among some or ail states over time. Thus, the formal language frame wor of fiizzy automata is 
particularly well-matched to signal separation applications. In addition, the operation of each fuzzy automaton Is inde- 
pendent of the durations of the incoming signals. 

35 SUMMARY OF THE INVENTION 

[0005] In accordance with the teachings of the present invention, a method Is provided for deriving a near-optimal 
fuzzy automaton for a given separation problem. The method Includes the steps of (a) fonnlng a first generation 
population of fuzzy automata, where the first generation population of fiizzy automata includes a plurality of fuzzy 

^0 automata (b) performing a mutation operation on each fuzzy automaton in the first generation population of fiizzy 
automata (c) reproducing the first generation population of fijzzy automata using a survival of the fittest operation 
and (d) applying a cross-over operator to the reproduced first generation population of fiizzy automata, thereby yielding 
a next-generation population of fiJzzy automata. A near-optimal fiizzy automaton is identified by evaluating the per- 
formance of each fuzzy automaton in the population othen/vise the methodology is repeated until a near-optimal fiizzy 

45 automaton is derived for the given separation problem. 

[0006] Additional ob ects, features and advantages of ttie present invention will become apparent from the following 
description and appended claims ta en in con unction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

50 

[0007] Figure 1 is a diagram depicting an exemplary signai classifier implemented In accordance with the present 
Invention 

[0008] Figures 2A and 2B are flowcharts illustrating a method for deriving near-optimal fuzzy automata for a given 
separation problem in accordance with the present invention 
55 [0009] Figure 3 is a diagram depicting an exemplary crossover operation t)etween two fuzzy automata in accordance 
with the present invention and 

[0010] Figure 4 is a flowchart illusti^ating a method for deriving a signal classifier In an evolving signal environment 
In accordance with the present Invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



[001 1] Figure 1 illustrates an exemplary signal classifier 1 0 that is implemented using fuzzy genetic learning automata 
In accordance with the present invention. Each of the fuzzy genetic leaming automata are dedicated to leaming and 
separating a specific signal or a particular set of signals from an evolving signal environment As will be apparent to 
one s illed in the art two or more fuzzy automata may be used to implement the signal classifier 10. In a prefened 
embodiment, each of the fuzzy automata are Implemented as individual software agents. 

[0012] In operation, the signal classifier 10 receives a plurality of input signals 12 from a signal environment The 
input signals 12 are evaluated by each of the fuzzy automata. For illustration purposes, a first automaton, 3, is 
intended to classify Signals 1 and 3 and distinguish them from Signal 2 whereas a second automaton, U2, is intended 
to classify Signal 2 and distinguish it from Signals 1 and 3. Each fuzzy automaton outputs a confusion matrix, where 
the rows of the matrix are output vectore arranged according to the input signals. For Instance, when Signal 1 is pre- 
sented to the first automaton. A, 3, the first row of the confusion matrix is ideally [1 0 0]. Simiiariy, when Signal 3 Is 
presented to the first automaton, A, 3, the third row of the confusion matrix is Ideally [0 0 1]. U ewise, when Signal 2 
is presented to the second automaton, A2 the second row of the confusion matrix is ideally [0 1 0]. Thus, the resulting 
output from the signal classifier 10 is an aggregate confusion matrix 14 having the appropriate rows fnm each of the 
individual automata, in this example, the firet and third rows of the aggregate confusion matrix correspond to the first 
and third rows of the confusion matrix from the first automaton, and the second row of the aggregate confusion matrix 
corresponds to the second row of the confusion matrix from the second automaton. It is noteworthy that the aggregate 
perfbmiance of a signal classifier built from two or more fuzzy automata is typically better than the performance of 
each individual fuzzy automaton. 

[001 3] A method for deriving a near-optimal fiizzy automaton for a given separation problem Is shown In Figures 2A 
and 2B. In accordance with the present invention, the near-optimal fuzzy automata may then serve as the basis for a 
signal classifier. Firet, a separation problem must be identified 22 finom the signal environment A separation problem, 
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[0014] Initially, an input set of fuzzy automata Is chosen stochastically by pulling elements of S, R. and E*' at random 
fipom the unit interval until a set of fiizzy automata with some positive separability is realized. A population of fuzzy 
automata, ayo, flU^ su« ^ n 

X n n X ^ 

n n X ^ n X ^t^c 

jc 71 n " 

[0015] A genetic algorithm is iteratively applied to the population of fuzzy automata until a near-optimal fuzzy autom- 
aton is derived for the given separation problem. In general, a genetic algorithm is a model of leaming which derives 
its behavior finom a metaphor of the processes of evolution as they occur in nature. In nature, the membere of a pop- 
ulation are derived from and represented by chromosomes. U ewise, the membere of a population of fiizzy automata 
must be represented in a chromosome paradigm In order to apply a genetic algorithm. 

[0016] In accordance with the present Invention, at least the first three elements of the uintuple U, which 
are ijS, yR, uE®, are redefined 26 in chromosome fbrni. In particular, each data value of each matrix which comprises 
an element of the fiizzy automaton is represented as a binary word. For example, yS is defined as follows 
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where each data value is 



uSh.i.j= luSh,i.j)o °tuSh.i.j)i ° - °luSh.i.j)„_i 



such that each term (yS^ , ) in the concatenation is an element of 0, 1 and o is the concatenation operator. Ac- 
cordingly, each data value, ^8^^^ , of the matrix is a chromosome, e.g., 00101...0011, of some length n. As will be 
apparent to one s illed in the art, and yE^ can be similarly redefined in chromosome form. 
[001 7] A mutation operation can then be applied 28 toeach of the fuzzy automata in the population. Toeffect mutation, 
a small number of data entries In S, R, and E° x XX 

X THE -> -> 7C X 3 

3jb b 1 m ulo2 b m mb o 0 1 p mbo m mu o o I o u m 

u om o ^ 

[001 8] For illustration purposes, consider a 2x4x3 fiizzy automaton where the random entries chosen for mutation 
are mar ed with a star as follows 



« • • 



• • • 



] 



J 



Thus, there are two data entries where mutation by bit flipping occurs ySi.i.o and uro^2- Within each data entiy, a 
random location is then selected. For example, suppose that the third bit is flipped for uS^.i.o and the fifth bit is flipped 
for uro,2- The resulting mutation operation would be as follows 
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(u '■0.2 )o ° (u ^"0.2 ), ° (u '"0.2 )2 ° • • • *• (u ^0.2 ), => 

(u ^0.2 )o ° (u ro.2 ), ° • • • - ro,2 jj ) o (u To 2 \ o (u To 2 ), 



One s illed in the art wilt readily recognize that the above description is merely exemplary of a mutation operation. It 
20 is envisioned that other rules may be devised for effecting a mutation operation within the scope of the present invention. 
[0019] Next, the first generation population of fiizzy automata is reproduced in accordance with a survival of the 
fittest operation. As will be more fiilly explained below, reproduction involves the following three steps (1) evaluating 
the fitness 30 of each fuzzy automata in the population, (2) ran ing the fuzzy automata 32 within the population ac- 
cording to the fitness of each fuzzy automata, and (3) reproducing at least one of the fuzzy automata 34 in accordance 
25 with some reproduction rule. 

[0020] First, each of the fuzzy automata are evaluated for fitness via a fitness function. In a preferred embodiment 
of the present Invention, the fitness of each fuzzy automaton Is assessed using a diagonal dominance Indicator. While 
the following description is provided with reference to a particular fitness function, it is envisioned that other nown 
fitness functions fall within the broader aspects of the present invention. 
30 [0021] In order to detennine a diagonal dominance indicator for a fuzzy automaton, a set of input signals must be 
identified from the signal environment The set of input signal are evaluated by each fuzzy automaton in the population, 
thereby yielding a confusion matrix for each fiizzy automaton. A diagonal dominance indicator is computed for each 
confusion matrix, where a figure of merit for diagonal dominance, D, is provided as follows 

35 

^ (^smallest on-diagonal " ^largest off-diagonal) ^ ((^snoaitest on-diagonal 

^largest ofF-diagonai)^^)- 

40 For illustration purposes, the diagonal dominance indicator for an exemplary confusion matrix of 



1.17 .21 .23 
.00 1.24 .36 
.10 .22 1.26 



50 Is computed as D (1.17 - 0.36)/((1.17 0.36)/2) 1.06. As will be apparent to one s illed in the art, a diagonal dom- 
inance indicator for a confusion matrix may be computed In accordance with other nown figures of merit 
[0022] Second, each of the fiizzy automata in the population are ran ed according to the fitness of the Individual 
automaton, where the diagonal dominance indicator is Indicative of the fitness of an automaton. More speclficaliy, the 
fuzzy automata are ran ed from the fuzzy automata having the largest diagonal dominance to the fiizzy automata 

55 having the smallest diagonal dominance. 

[0023] Third, at least one of the fuzzy automata in the population is reproduced in accordance with a reproduction 
rule. In accordance with a survival of tiie fittest approach, the reproduction rule Is fashioned such that the highest 
ran ing fiizzy automata are reproduced and tiie poorest ran ing automata are eliminated. For example, given a pop- 
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ulation of eight fuzzy automata^ an exemplary reproduction nile niay specHy that the two highest ran ing automata are 
duplicated, the four middle ran Ing automata are maintained, and the lowest two ran ing automata are eliminated. This 
exemplary reproduction rule is Illustrated as follows 

( )=> 



10 



15 



This particular reproduction rule has the advantage of maintaining a constant population size of eight It is envisioned 
that other types of reproduction rules fall within the scope of the present Invention. 

[0024] Once the population of fuzzy automata Is reproduced in accordance with a survival of the fittest operation, a 
uni ue crossover operatormay be applied 36 to the population of fiazy automata. In general, fuzzy automata crossover 
operates on two fuzzy automata, U and V, from a particular generation of automata, and produces two new fuzzy 
automata, W and , belonging to a next generation of the population. More specifically, the crossover operator is 
specified as a transform 2«pX^^^ () ^ 

( H) X w 



20 



)) ( H) 



25 



X 7t 

[0025] In the transform S^, 



n 



A* and are not involved in the crossover operation. 
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[0026] The operation of the transfbim E^,x X ^^XX 

^ in X 

I 

S;h,i,j S;h,i,j 

X Z £ 1 n 1 K 

^ r 'i'z X n K 

X 

[0027] The second element of W, ^R, is generated similariy as follows 



Wh.i.j = lurh,i.jjo "(u'-h.i.j), " - °iu\i.jL , '(Vh.yl " - » (v rh.i.j )„_, 

*v.,n»i,j K,n.Lj 
for each data value y^r^^^^ within yyR. U ewlse, the third element of W, y^E^, is generated as follows 

E";h.i.J E^;h,ij 

[0028] The next generation fuzzy automaton, , is generated in a similar manner. However, in this instance, thefront 
portion of the chromosome comes from V and the tail portion of the chromosome comes from U. Each element of Is 
further expressed below. The first element of , S, Is generated as follows 

for each data value within S. The second element of , R, Is generated as follows 



X = iv '•h.i.j )o - Iv '•h.i.j ), ° • • Hv rh.i.j )kR.^. .-1 " j )kR.^ . . * • ■ • ' (u \ui Li 
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for each data value R. The third element of , E^, is generated as follows 



EO;h,i.j 



for each data value of E^. Thus, the crossover transfonn has been described In complete detail. 

[0029] For illustration purposes, an exemplary crossover operation is illustrated below. Suppose U and V are as 

follows 



uS = 



0011000000 0000100111 j 
0011011111 0011000101 J 



0001101010 0011111011 
0001101001 0000100011 



vS = 



0100010110 0010110101 
0000110000 0001011011 



J 



0010011011 0011100000 
0000101011 0000111101 



uR and u^^ v^^- In addition, the crossover allele, y 



is 8 
(8 8_ 



n 



K 



n 



=41 



71 



X 



n 



n 



X X ^ ^ n 

^ X X 2: 

[0030] Although tiie present Invention Is not limited as such, tiie above-described crossover operation is applied to 
the first generation population of fiizzy automata by randomly selecting pairs of fuzzy automata from the population 
and then applying the crossover operator to each pair of fuzzy automata. For a population of eight fuzzy automata, the 
crossoveroperatorisapplied to four randomly selected pairs of fuzzy automata, inthis way, a next generation population 
of fiizzy automata have been derived for the given separation problem. 

[0031 ] LasUy, each of the fuzzy automata In tiie next generation population Is evaluated for perfomfiance 38 in view 
of tiie given separation problem. In a prefened embodiment each fuzzy automaton is evaluated using tiie above- 
described fitness function. If one of the fuzzy automata exceeds some predefined performance threshold (e.g., a min- 
imum diagonal dominance value), then algorithm is complete, thereby yielding a near-optimal fuzzy automaton 40 for 
the given separation problem. On the other hand, if none of the fuzzy automata in the next-generation population 
exceeded the performance threshold, then the process Is repeated starting with the next-generation population serving 
as tiie input to the mutation operation. The genetic algorithm of the present invention can be repeated until at least 
one fiizzy automaton exceeds the perfomiance ttireshold associated witii the given separation problem. As will be 
apparent to one s illed in the art, employing a genetic algorithm liaving the basic elements of mutation, reproduction 
of the fittest, and crossover guarantees convergence upon a near-optimal solution for the given separation problem. 
While tiie above description of the present invention has been provided with reference to a particular genetic algorithm, 
there are ottier nown generation-level genetic operations (e.g., blended crossover, gray coding, eto.) which may be 
Incorporated into the overall framewor of the present Invention. 
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[0032] A signal environment, G x) xnx t t tt 

XT X T tX X X 

TX(X T^X) U XTIXTI Z(X) XTIX 

X 

[0033] Refening to Figure 4, a method is provided for deriving a signal ciassifier in an evolving signal environment 
As previously described, a single fuzzy automaton at a fixed epoch in history X x x x 

XX' X XX XXX XX T XXX 

XXTl XX X XTCXn XXTtXTC S 

(X) 7t XX X X 71 X 7C (Z(x)) (I{t)) (L(x))y XXX 



/=0 



[0034] In accordance with the present invention, a near-optimal fuzzy automaton may be derived 44 for each Indi- 
vidual separation problem using the above -described genetic algorithm. Thus, each of the fuzzy automata would learn 
to produce positive diagonal dominance for the signals representing its part of the problem (£(x))/, as well as not to 
have diagonal dominance for the rest of the signal problem £(x) (£(x))/ 

[0035] An aggregate confusion matrix can be fbnned 46 from the resulting set of near-optimal fiizzy automata. The 
aggregate confusion matrbc Is used to evaluated 48 the set of fuzzy automata in view of the overall separation problem. 
If the set of fuzzy automata exceeds some predefined perfonnance threshold, then the set of fuzzy automata can be 
used as the basis for a signal classifier. On the other hand, if the set of fiizzy automata does not exceed the perfonnance 
threshold, then the separation problem Is repaititioned, and the process is repeated. U ewise, the signal classifier is 
periodically re-evaluated over time as shown at 52 In order ensure that its performance meets some minimum per- 
formance threshold. If the signal classifier does not exceed the performance threshold, then the above-described meth- 
odology is reapplied to the separation problem. In this way, changes in the environment are learned as the epoch is 
advanced. 

[0036] The foregoing discussion discloses and describes merely exemplary embodiments of the present invention. 
One s illed in tiie art will readily recognize from such discussion, and from the accompanying drawings and claims, 
that various changes, modifications and variations can be made therein without departing from the spirit and scope of 
the invention as defined in the following claims. 



Claims 

1 . A method for deriving a near-optimal fuzzy automata for a given separation problem, comprising the steps of 

(a) forming a first generation population of fuzzy automata, where the first generation population of fuzzy 
automata having a plurality of fuzzy automata 

(b) performing a mutation operation on each fuzzy automata In the finst generation population of fuzzy autom- 
ata 

(c) reproducing the first generation population of fiizzy automata using a survival of the fittest operation and 

(d) applying a cross-over operator to the reproduced first generation population of fuzzy automata, thereby 
yielding a next-generation population of fiizzy automata. 

2. The method of Claim 1 wherein the step of forming a first generation population fiirther comprises the step of 
defining each of the fiizzy automata in the first generation population as one or more matrices each having a 
plurality of data values, and representing in chromosome fomi each of the data vales In at least one the matrices 
in each of the fiizzy automata. 

3. The method of Claim 2 wherein the step of representing in chromosome forni further comprises converting each 
of the data values to a binary word. 

4. The method of Claim 1 wherein the step of peribmning a mutation operation fiirther comprises randomly fiipping 
at least one bit in each of the fiizzy automata, where the data values for each of the fiizzy automata are represented 



10 



EP 1 296 281 A2 



as a binary wcnxI. 

5. The method of Claim 1 wherein the step of reproducing the first generation population further comprises the steps 
of 

evaluating the fitness of each fuzzy automata In the first generation population of fuzzy automata 

ran ing the fiizzy automata in the first generation population of fiizzy automata according to the fitness of each 

fuzzy automata and 

reproducing at least one of the fuzzy automata In accordance with a reproduction rule. 

6. The method of Claim 5 wherein the step of reproducing at least one of the fuzzy automata further comprises 
defining the reproduction mie such that the two highest ran ed fiizzy automata in the first generation population 
of fiKzy automata are duplicated and the lowest two ran ed fiizzy automata in the first generation population of 
fiizzy automata are eliminated. 

7. The method of Claim 1 wherein the step of applying a crossover operator fiirther comprises the steps of 

randomly identifying at least two of the fiizzy automata In the first generation population of fuzzy automata, 
where each of the twofuzzy autonriata is defined by one or more matrices each having a plurality of data values 
representing in chromosome fbnn each of the data values In at least one of the matrices In each of the two 
fiizzy automata and 

applying a crossover operator to the at least one matrix in each of ttie two fuzzy automata, where the crossover 
operator determines the alleles of crossover between the two fiizzy automata, thereby yielding two next-gen- 
eration fijzzy automata. 

8. The method of Claim 7 wherein the step of representing in chromosome fonn further comprises converting each 
of the data values to a binary word. 

9. The method of Claim 7 wherein the step of applying a crossover operator fijrther comprises a transfbmi matrix 
having the same dimensions as the at least one matrix in each of the two fuzzy automata, where the entries in the 
transfonn matiix are numbera that detennlne tlie alleles of crossover in the corresponding data values of the at 
least one matrix in each of the two fiizzy automata. 

10. The method according to any of tiie preceding claims fiirther comprising the steps of 

evaluating the perfomiance of each fuzzy automata in the next generation of fiizzy automata in relation to the 
given separation problem and 

repeating steps (b) thru (d) until at least one fiizzy automata from the next-generation of fiizzy automata 
achieves a satisfactory perfomnance level in relation to the given separation problem. 
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